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ABSTRACT 

Fiscal and monetary policies taught in macroeconomic 
principles courses are concepts that might require both lecture and 
simulation methods. The simulation models, which apply the principles 
gleened from comparative statistics to a dynamic world, may give 
students an appreciation for the problems facing policy ma)c«rs. This 
paper is a report of a pilot study of a policy making simulation, 
"Macroism," provided by a publisher as part of a package for a 
macroeconomics textbook conducted at Southeast Missouri state 
University. A review of studies concerning learning and economic 
simulations reveals that computer assisted instruction has an effect 
on learning, but does not establish a clear relationship to the 
text/lecture approach of instruction. "Macroism" is based on an 
econometric model of the United States economy, and is availeOJle for 
both Apple and IBM computers in an interactive or classroom version 
(used for this study). While the students clearly enjoyed the 
simulation, there is limited evidence that student learning improved 
as a result of participation in the simulation, students • cognitive 
abilities in the area of policy making are likely to be enhanced as a 
result of playing "Macroism," but more study is needed in this area. 
Nine references and a "Macroism" sample problem are included. 
(PPB) 
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Pilot study: Impact of Microcomputer Simulation on Students' 
Economic Policy Performance 

Bruce R. Domazllcky and Judith France 
Southeast Missouri State University 

I. Introduction 

Many concepts In principles of economics are, perhaps, best 
explicated via the lecture method. These might Includ^a such concepts as 
opportunity costs., the Keynes Ian Cross diagram, and efficiency of the 
competitive market model. Some concepts, however, are difficult for 
students to grasp from viewing a lecture. These may require additional 
methods of teaching as simulations or games for fuller comprehension by 
students . 

Fiscal and monetary policies which are taught In the macroeconomic 
principles course are concepts which might require both lecture and 
simulation methods. Lectures can be used to teach the basic approaches 
and tools of policy-making. However, "Simulation models, which 'apply the 
principles gleaned from comparative statics to a dynamic world, may give 
students an appreciation for the difficult problems confronting 
pollcy-makers.»» (Siegfried and Fels [1979, p. 940]) 

This paper Is a report of a pilot study of a policy-making 
simulation which Is being conducted at Southeast Missouri State 
University. The simulation which Is being used Is provided by a book 
company as part of a package for a principles of macroeconomics textbook 
(Byrns and Stone [1987]). After a brief review of earlier research on 
simulations, the third section of the paper will describe the Byrns and 
Stone simulation (called Macrosim) and the results of Its use In five 
sections of Principles of Macroeconomics. The final section of the 
paper will Include a summary and evaluation of the evidence. 
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II. Recent Research o*^ Simulations 

In 1979, Siegfried and Pels were compelled to state that ''•••the 
conclusions about the effectiveness of CAI Cgames and simulations] In 
Improving understanding of economics are pessimist Ic^** (Siegfried and 
Pels C1979, p^ 940]) The evidence from studies seemed to Indicate that 
students enjoyed learning by playing games and simulations, but that 
there was little or no advantage from such methods as compared to the 
traditional lecture/ textbook approach • 

One exception to the conclusion of Siegfried and Pels was the study 
by Emery and Enger Cl972]^ Their use of a fiscal policy simulation 
appeared to Improve student understanding of various fiscal policy 
concepts^ The evidence consisted of a statistically significant 
difference In Improvement from a pre-test to a post-test for styder»ts 
playing the game versus those who did not^ 

Schenk and Silvia C1984] listed several reasons why researchers. In 
general, may not have found simulations and games to be superior to -^he 
traditional textbook/ lecture approach • In some cases, the Instructional 
materials may not have been very good. Clearly, some of the earliest 
simulation models appear woefully simplistic and naive when compared to 
the complex computer models of today • But even If the simulations are 
we 1 1 -constructed, they could be Improperly used^ As Schenk and Silvia 
point out C1984, p^ 241], for simulations to be effective they need to 
be complemented with student guides and explicit Instructional 
object ives^ There are further problems with the evaluation of the 
effectiveness of simulations^ Student benefits from participation In a 
simulation may include Improved analytical and critical thinking, a 



better appreciation of the difficulties of pol Icy^naklng, as well as 
greater familiarity with computer technology* A TUCE-based evaluation 
would have a tendency to underestimate the total benefits from a 
simualtlon* 

A carefully designed study of simulations by Fraas was 
successful In anticipating some of the problems outlined by Schenk and 
Silvia* As a result, Fraas was able to draw some very specific 
conclusions from his experience. He found that students with lower 
pre-course TUCE scores tended to learn more when they were taught by 
simulatlon/gaming methods. Students with higher pre-course TUCE scores 
learned more when taught by the lecture/discussion method. A similar 
dichotomy existed when students were grouped by SAT scores. Those with 
lower SAT scores learned more In a simu lat lon/gaming classroom while 
those with higher SAT scores did better In a lecture/discuss I on format. 

A more recent study by Post [1985] concludes that computer 
simulation and games (CAD do Improve student scores but not 
significantly more than do traditional assignments. He does conclude 
that CAI Is better than lecture aK-^ne, though his evidence for such a 
conclusion Is not that well documented. 

It would appear from this brief summary of some of the research 
that further study of simulation as a teaching technique Is needed. 
This Is warranted not only to address the one question which has 
dominated the research-Is CAI more effective than the lecture/text 
approach«-but also to assess Its role In achieving some of the other 
objectives as outlined by Schenk and Silvia [1984]. The next section 
will present both anecdotal and statistical evidence to assess the 
effectiveness of the Byrns and Stone simulation In a Principles of 



Macroeconomics course. 

III. Description of Macrosim and Evidence 

Robinson Cl983] states that simulations should demonstrate that 1) 
no one knows exactly how the economy operates, 2) pol lcy*-maklng Involves 
trade-offs between conflicting objectives and 3) accurate forecasting 
can Improve policy-making by removing potentially adverse situations 
before they occur. The Byrns and Stone policy simulation called 
Macrosim demonstrates these points quite adequately. 

Macrosim Is a simulation based on an econometric model of the U.S. 
economy. While the exact model Is not specified In the accompanying 
description of the simulation, the reader Is told that the model has a 
fairly realistic lag structure. Macrosim Is available for both Appio 
and IBM personal computers. There are two versions cf Macrosim: 1) an 
Interactive version which the student can play alone and 2) a classroom 
version wherein the Instructor enters all data and the students see only 
printouts from the computer. The Interactive version Is most 
appropriately used If the class size Is relatively small and students 
are familiar with personal computers. Because of large class sizes at 
Southeast Missouri State, the classroom version was used. 

To Implement the classroom version of Macrosim, students In five 
sections of Principles of Macroeconomics were divided Into groups of 
five or slx« (The sections averaged 35 students each.) Each group was 
given an Initial printout (see appendix for an example) which Included * 
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data on five economic variables (GNP, the unemployment rate, the 
Interest rate, the Inflation rate, budget balance) for the past six 
years. There are six possible scenarios from which to choose. The six 
are stable economy, recession, depression, budget deficit. Inflation and 
stagflation. The scenario which a student group faces Is described In 
the Initial printout so they have an Idea of the direction the economy 
Is heading when the Simula-^ Ion begins. 

The role of the student group Is that of the President who must 
make choices for seven policy Instruments. The President receives 
advice (which Is generally limited In usefulness) of various types: 
political, economic and military. Given the advice and the economic 
conditions, the group then makes decisions on the seven policy 
variables. There are four fiscal policy variables: excise taxes, tax 
rates, government spending, and Investment tax credits. There are three 
monetary policy variables: open market operations, the discount rate and 
reserve requlremnts. The policy options which the students have are: 
Increase a policy variable (0 to 10]K), decrease a policy variable (0 to 
-10$) and no change. The students tend to learn quickly that large 
changes In policy variables can frequently have destabilizing effects on 
the economy. 

The policy simulation can be conducted for up to eight periods. 
The procedure Is to give students their Initial printouts outlining the 
data on the economy and the scenario which they face. The students then 
submit their policy choices. Generally, the first time this Is done 
requires about 30 minutes. At the beginning of the next class period, 
students receive new printouts which give the results of their policy 
choices on the five economic variables (GNP, unemployment, etc.) The 



students then evaluate their results and submit new policy options. It 
usually takes about 15-20 minutes for the second and subsequent periods. 

Instructor time to enter student choices and to generate new 
printouts Is, minima I. For 15 groups the time required was about 40 
minutes per period. The actual entering of data Is quite simple and 
could easily be done by a graduate student or student worker. 

The students clearly enjoyed the simulation experience, even though 
at times they were frustrcted by the results which they obtained. For 
example, six groups played the simulation under the budget deficit 
svenarlo. Every group prKlpltated a recession In trying to narrow the 
deficit. This, of course, caused the actual deficit to grow larger. 
Despite these types of setbacks, students were eager to participate In 
the simulation. Attendance In all sections Increased during the time 
the simulations were conducted. On a post-course student evaluation In 
three of the sections, students were asked what they liked best about 
the course. By a ten to one margin they Indicated the simulation was 
their favorite part of the course. 

The TUCE (Saunders Cl980) was used to assess the learning of 
students who played Macros Im. Their results on the Macro TUCE, version 
A were compared to students In six sections who did not participate In 
Macros Im. The latter students took Principles of Macroeconomics from 
two other Instructors, but they used the same text, Byrns and Stone 
C1987D. A pretest was not administered In all sections, so comparisons 
were not possible as to economic knowledge possessed by students In the 
different sections (five with Macrosim and six without). However, 
testing %\fh the TUCE from previous semesters had yielded a fairly 
consistent average of 9.3 right (3\%) on the pretest. There was no 



reason to expect any significant deviations froin that pre-course 
average. 

Eighteen questions (2,4,6,9,11,12,13,16,18,19,20,22,23, 
24,25,27,29,30) were Identified beforehand as policy or policy-related 
questions. The twelve remaining questions were deemed to be nonpollcy 
questions. It happened that 135 students from the five Macros Im 
sections and 135 students from the six sections without Macros Im took 
the posttest. Macro TUCE A. For the 12 nonpollcy questions, the mean 
was 50. 4j correct for the Macrosim sections and 47 .3j correct for the 
sections without Macrosim. The difference In the means Is not 
significant at the )0% level (t » 1.45). For the eighteen policy 
questions, the students In the Macrosim sections achieved a mean of 
43. 6J correct vs. 36. 2j for the students without Macrosim. The 
difference In the means Is significant at the 5% level (t ^ 3.51). The 
eighteen policy questions were also divided into the three types of 
questions suggested by Saunders 019813: recognition and understanding, 
explicit application and Implicit application. In all three cases the 
means of the Mwrosim sections were approximately seven percentage 
points higher than the means of the sections which did not use Macrosim. 
This offers some evidence that Macrosim Improved understanding of policy 
for students who participated In the simulation. Ciearly^ they learned 
no less. The fact that both groups performed about as well on the 
nonpollcy questions would give some Indication that the difference In 
means on the policy questions was not due to other factors as student 
Intelligence, motivation, etc. However, It would be useful to test for 
the Influence (if any) of these other factors. 
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tV. Sumnary and Evaluation 



The experience with Macroslm at Southeast Missouri State Is similar 
to what has been found for simulations at other colleges and 
universities. The students clearly enjoyed the simulation; most said It 
was their favorite part of the course. There Is limited evidence that 
student learning Improved as a result of participation In tho 
simulation. 

The pilot study on the effects of Macroslm on student learning 
needs to continue for several semesters. There Is a need to control for 
student and Instructor differences In order to get a clearer picture of 
the simulation's effectiveness. The use of the TUCE both pre and post 
In all sections would be a major step In that direction. 

Despite the need for further study, a few tentative conclusions can 
be made by way of a summary evaluation, Macroslm Is a sophlstcated 
simulation of pol lcy*-maktng In the mteroeconomy which can give students 
a greater appreciation of the difficulties of fomulating policies In a 
complex economy. Student's cognitive abilities In the area of policy 
are likely to be enhanced as a result of playing Macroslm, though more 
study Is needed In this area. Students enjoy playing Macroslm and It 
can be useful In generating Interest In economics. Given the nature of 
Macroslm, It cannot be used until the last few weeks of the course. 
This means that Macroslm can be used as a summary Instrument for many of 
the topics In a principles of macroeoconomlcs course. In that way. It 
makes an Ideal "capstone" for such a course. 
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TEAM Y: 



MArPCSIM iir -i ma . '.ji . r>.jm lo <-(ii'_r it ■■ l u 1 n^^ic,.--: -o r.ro/ide players 

with a sopl: istica'ei.: an--, en j oy.-i:: if l i d t.Tiei c r.iacro" oncinic poiiTy r.aking. 
"Jrounced 3 r. -;-un.:: n'acro thoorv, ti-.f- s , , u la*, i c ri . 1 1 r..-' i-he" interdependenci^ 
<-f ecoiiomic mechanism:? ari t;!ie pT-ol,!.^'; c'li -uiin^er 1 c: v --■r'-. . n <' bodies in forr 
ulating staoie economic folicy. 



THE INITIAL SCENARIO: 

The econoiTiy is sliding ir.t-o i i.er ?s " i Oii ■•'-1 v.l cr . • ■''-^-t, dr. ; th'c'.r^^ is a 
sizable budget deficit. The voteis hor-^ / u ;m;. cJ--^1 ;•(-•- ycur pror.iise to 
reverse the decline anc balance tht. 'oU'J..3't-t oof-.ie tiv- • ^^:■t- t'jtction. Good 
luck! 



iCONOMIC TREXD DATA: 



Year 
2000 
1999 
1998 
1997 
1996 
1995 



GNP 

1878 Bil 

1743 Bil 

1578 Bil 

1<84 Bil 

1340 Bil 

1282 Bil, 



L'n-- TP ] oy p. t 
7.1 % 



9 
10 



b '5 
8 % 



i rt' >r-st 

S .0 % 

6.5 % 

.2 i 

7.4 % 
6.8 

5.2 % 



p ;■ 



C.4 

5.:; 
5. 

5 
4 
3 



4 ; 
1 % 

7 % 



B\- o';- Balance 
-I'^.^i Eil. 
-loo B 1 i . 
-135 Eil. 
-120 Bil. 

-54 Bil. 

-io Bil. 



^DVISOR COMMENTS: 

ECONOMIC: Tax cuts may overstimuldt.e coiisurner and i;ivestnient spending. 

Are you willing to accept more inflation? 
POLITICAL; I talk to my chauffeur to get a sense of v/hat poor people think, 

and she thinks your policies are just about perfect. 
MILITARY: We need another twenty-floor parking garage at the Pentagon to 

accommodate all of our new personnel. 
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